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Abstract. It is well known that if one integrates a Schur function indexed by a partition A over the 
symplectic (resp. orthogonal) group, the integral vanishes unless all parts of A have even multiplicity (resp. 
all parts of A are even). In a recent paper of Rains and Vazirani, Macdonald polynomial generalizations of 
these identities and several others were developed and proved using Hecke algebra techniques. However at 
q = (the Hall-Littlewood level), these approaches do not work, although one can obtain the results by 
taking the appropriate limit. In this paper, we develop a direct approach for dealing with this special case. 
This technique allows us to prove some identities that were not amenable to the Hecke algebra approach. 
Moreover, we are able to generalize some of the identities by introducing extra parameters. This leads us to 
a finite-dimensional analog of a recent result of Warnaar, which uses the Rogers-Szego polynomials to unify 
some existing summation type formulas for Hall-Littlewood functions. 



1. Introduction 

Two classical identities in the representation theory of real Lie groups are: 
Theorem 1.1. For any integer n > and partition X with at most n parts, we have 



f II, if all parts of X are even 

/ s x {0)dO = 

Joeo(n) 



'OeO(n) I 0, otherwise 

(where the integral is with respect to Haar measure on the orthogonal group). Similarly, for n even, we have 



s\(S)dS 



1, if all parts of X have even multiplicity 
0. otherwise 



(where the integral is with respect to Haar measure on the symplectic group). 

Here s\ is the Schur function in n variables indexed by the partition A. Schur functions have an intimate 
connection to representation theory: they give the character of an irreducible representation of the unitary 
group, U(n). In particular, the character's value on a matrix is given by evaluating the Schur function 
at the matrix's eigenvalues. Thus, the above identities encode the following facts: in the expansion of s\ 
into irreducible characters of 0(n) (resp. Sp(n)), the coefficient of the trivial character is zero unless all 
parts of A are even (resp. all parts of A have even multiplicity). These identities can be proved using the 
Gelfand pairs (G, K) = (GL„(R), 0(nj) and (GL n (M),U(n, EE)) and the decomposition of the induced trivial 
representation into irreducible representations of G, see [11]. For example, the orthogonal group identity 
follows from the structure result 

e K P{G) = P{K\G) S F 2X (V) 

l(X)<n 

(in the notation of [11]) and the fact that the Schur function gives the character of a polynomial representation 
of GL„(R). 

Note that using the eigenvalue densities for the orthogonal and symplectic groups, we may rephrase the 
above identities in terms of random matrix averages. For example, the symplectic integral above can be 
rephrased as 

f s\(z 1 ,Zi 1 ,z 2 ,Z2 1 ,...,z n ,z~ 1 ) Yl \ z i~Zi X ? II {Zi + z^ 1 - Zj - z^fdT, 



2 n n\ 



T l<j<n l<i<j<n 
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where 

T = {(zi, . . . , z„) : \zi\ = ■■ ■ = \z n \ = 1} 



2lT\/—lZj 

3 

are the n-torus and Haar measure, respectively. Such identities, and their generalizations, have consequences 
outside symmetric function theory. For example, in their work dealing with symmetrized generalizations of 
the Hammersely process [4], Forrester and Rains developed an a-generalization of the above orthogonal 
group identity. 

A natural question, then, is whether such identities admit a q 7 t generalization to the level of Macdonald 
polynomials. In [12], a number of such identities were conjectured: that is, a suitable choice of density was 
suggested so that integrating Macdonald polynomials against it should vanish unless the partition is of the 
appropriate form, and such that when q = t 7 these identities become the known ones for Schur functions. 
In [13], Rains and Vazirani developed Hecke algebra techniques which enabled them to prove many of these 
results. In fact, only Conjectures 3 and 5 of [12] remain open. 

An interesting subfamily of the Macdonald polynomials are the Hall-Littlewood polynomials which are 
obtained at q = 0, see Chapter 3 of [11]. Unfortunately, none of the above proofs work at this level: they 
involve q-shift operators, which do not behave well at q = 0. In this paper, we develop a direct method 
for dealing with these cases. This method allows us to explicitly obtain the nonzero values as well as 
generalizations involving extra parameters. We also prove Conjectures 3 and 5 from [12] for Hall-Littlewood 
polynomials. 

There are several nice consequences. The first involves a (recent) identity discovered by Warnaar for Hall- 
Littlewood polynomials [15]. He uses the Rogers-Szego polynomials to unify the Littlewood/Macdonald 
identities for Hall-Littlewood functions. We find a two-parameter integral identity and, using a method of 
Rains, we show that in the limit n — > oo it becomes Warnaar's identity. Thus, our identity may be viewed 
as a finite-dimensional analog of Warnaar's summation result. Another unexpected feature of the direct 
method we employ is an underlying Pfaffian structure in the orthogonal cases. It turns out that Pfaffians of 
suitable matrices nicely enumerate the nonzero values of these integrals. While Pfaffians are very common in 
Schur function identities (Schur functions are ratios of determinants) , to our knowledge this is the first time 
they are appearing in the Hall-Littlewood context. Finally, the identities below involve Hall-Littlewood 
polynomials with a parameter t, but in many instances the evaluation of the integral produces a polynomial 
in t 2 or \[t (see for example, the symplectic and Kawanaka integrals, Corollary 6.3 and 6.4 respectively). 
Thus these identities may be viewed as quadratic transformations of Hall-Littlewood polynomials. 

The outline of the paper is as follows. In the second section, we introduce some basic notation and review 
Hall-Littlewood polynomials. In the third section, we prove Hall-Littlewood orthogonality to illustrate our 
method of proof in a basic case. In the next section, we use Pfaffians and some technical arguments to prove 
a generalizations of the orthogonal integrals. In section 5, we use a Pieri rule to add one more parameter 
P to these identities. In section 6, we discuss special cases of the a, f3 identity. In section 7, we prove that 
in the limit n — > oo of the a, /3 identity, we recover Warnaar's identity. Finally, in the last section, we prove 
some remaining vanishing results from [13] and [12]. 

We mention some related work in progress. As was discussed above, many of the integral identities for 
t = (the Schur case) follow from the theory of symmetric spaces, and thus have a representation theoretic 
significance. In [10], Macdonald shows that Hall-Littlewood polynomials (and their analogs for other classical 
root systems) arise as zonal spherical functions on p-adic reductive groups. Given this construction, it is 
natural to wonder whether our identities can be interpreted as p-adic analogs of the Schur cases. In a 
follow-up project, we will show that this is indeed the case: we give another proof via integrals over p-adic 
groups. 

Finally, many of the integral identities of [13] involve Koornwinder polynomials, a 6-parameter BC n - 
symmetric family of Laurent polynomials that contain the Macdonald polynomials as suitable limits of the 
parameters. Just as in the Macdonald polynomial case, standard constructions via difference operators do 
not allow one to control the q = polynomials. The first step in obtaining an analog of the Hall-Littlewood 
polynomials is to produce a q = closed form. Such a formula is not known; in further work we will use 
orthogonality of Koornwinder polynomials to provide an explicit closed form [14]. We then use this result 
to prove the q = cases of the remaining identities in [13]. 
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2. Background and Notation 

We will briefly review Hall-Littlewood polynomials; we follow [11]. We also set up the required notation. 

Let A = (Ai,...,A n ) be a partition, in which some of the Ai may be zero. In particular, note that 
Ai > A2 > ■ ■ • > A n > 0. Let /(A), the length of A, be the number of nonzero Ai and let |A|, the weight of A, 
be the sum of the nonzero Ai. We will write A = /x 2 if there exists a partition \i such that A2i-i = \n = /ii 
(equivalently all parts of A occur with even multiplicity). Analogously, we write A = 2fA if there exists a 
partition \i such that Ai = 2^ (equivalently each part of A is even). Also let mi (A) be the number of Xj 
equal to i for each i > 0. 

Recall the t- integer [i] = [i] t = (1 — i 3 )/(l — £), as well as the t- factorial [to]! = [m][m — 1] ■ • • [1], [0]! = 1. 
Let 

^ r (t) = (i-t)(i-t 3 )...(i-o. 

so that in particular (f> r (t)/(l — t) r — [r]\. Then we define 

•^w-nlf^T-n^lf-n^wi 1 

i>0 3=1 i>0 K ' i>0 

and 

(A) • . / n 

n n ^=n7rzf&=nKw 

t>l j=l i>l y ' i>l 

so that the first takes into account the zero parts, while the second does not. The Hall-Littlewood polynomial 
P\(xi, . . . , x n ; t) indexed by A is defined to be 



e w ( xX n 



v\ (t) ^— ' V -l-^ Xj — x 

y ' t»eS„ l<i<j<n l 

where we write x x for x\ 1 ■ ■ ■ x^ and w acts on the subscripts of the Xi. The normalization l/v\(t) has the 
effect of making the coefficient of x x equal to unity. (We will also write P^ n \x;t) and use P\{x^ m \ y^; t) 
to denote P\(x\, . . . , x m , yi, . . . , y n ',t) in the final section). We define the polynomials {R^\x;t)} by 
R^\x;t) = v\(t)P^ n \x;t). For w € S n , we also define 

(2.1) R{ n l(x;t)=w(x* [] X -f^-\ 

• V J -- L Xi — X; / 

l<i<3<n J 

so that R^ w (x] t) is the term of R^\x; t) associated to the permutation w. 

There are two important degenerations of the Hall-Littlewood symmetric functions: at t — 0, we recover 
the Schur functions s\(x) and at t = 1 the monomial symmetric functions m\{x). We remark that the 
Macdonald polynomials P\(x;q,t) do not have poles at q = 0, so there is no obstruction to specializing q to 
zero; in fact we obtain the Hall-Littlewood polynomials (see [11], Ch. 6). Similarly, when q = t (or q = 
then t = 0), P\(x;q,t) reduces to s\(x). 

Let 

bx(t) = n<W)W = «a+(«)(i - t) iw - 

i>l 

Then we let Q\(x; t) be multiples of the P\(x; t): 

Q x (x;t) = b x {t)P x {x;t); 
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these form the adjoint basis with respect to the f-analog of the Hall inner product. With this notation the 
Cauchy identity for Hall-Littlewood functions is 

1 - tXiUj 



(2.2) ^P A (x;t)Q A (x;t)= J] - 



ij>i J 



We recall the definition of Rogers-Szego polynomials, which appears in Sections 5-7. Let to be a non- 
negative integer. Then we let H m (z;t) denote the Rogers-Szego polynomial (see [1], Ch. 3, Examples 
3-9) 



(2.3) H m {z;t) = J2z 

where 

TO 

i 



[TO 

L i 



if to > i > 



[m-»]![*]P 

0, otherwise 



is the i-binomial coefficient. It can be verified that the Rogers-Szego polynomials satisfy the following 
second-order recurrence: 

H m {z-t) = (l + z)H m ^(z;t) - {l-t m - x )zH m _ 2 {z;t). 
Also, we define the symmetric q = Selberg density [13]: 

4 n) (*;*)= n 

1 -j . r zx^x ■ 

and the symmetric Koornwinder density [9]: 

1 1 — r ±2 1 — x ±1 x ±1 
(2.4) A i £ ) (x;a,b,c,d;t) = TT 1, rr- i ^ ^ TT W^tt, 

where we write 1 — x^ 2 for the product (1 — £ 2 )(1 — x^ 2 ) and 1 — xf 1 x^ :1 for (1 — XiXj)(l — x^ 1 xj 1 )(l — 

x~ 1 Xj)(l — XiXj 1 ) etc. For convenience, we will write and Ajp (a, b, c, d) with the assumption that these 
densities are in x\, . . . ,x n with parameter t when it is clear. We recall some notation for hypergeometric 
series from [13] and [12]. We define the g-symbol 

(a;q)= - aq k ) 

k>0 

and (ai,a,2, ...,ai;q) = (ai; g)(a 2 ; g) ■ ■ ■ (at;q). Also, let 

n-l 

(a;q)n = Y[( 1 

for n > and (a; g)o = 1. We also define the C-symbols, which appear in the identities of [13]. Let 

i<fi(,) iq 1 x;q) 

(*;?.*)= 11 rafaF?^ 11 



(q^t l W- i x;q) 11 (q^-^p-^x-.q) 

1<*<Km) l<i<7<i(*0 
J 11 ( 2^2-2* ) 11 (gW+PJia-i-iaj-g)- 

We note that C°(x;g, i) is the g,t-shifted factorial. As before, we extend this by C° ,± (a 1 ,a2, . . . ,a;;g) 
C°' ± (a 1 ;g)---C0. ± (a i ;g). 
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We note that for q = we have 

l<i<l(jt) 
C+(x;0,i) = l. 



Finally, we explain some notation involving permutations. Let w £ S n act on the variables z%, . . . , z„ by 

w(z 1 ■■■z n ) = z w{1) ■ ■ ■ z w{n) 

as in the definition of Hall-Littlewood polynomials above. We view the permutation w as this string of 
variables. For example the condition 11 Zi is in the fc-th position of w" means that w(k) = i. Also we write 

Zi Zj 

if i = w(i') and j = w(j') for some i' < f, i.e., appears to the left of Zj in the permutation representation 
z w(i) • • • z w(n)- For w € S2n, we use w(x 1 1 , . . . , x^ 1 ) to represent z w m • ■ • z w (2 n ), with Zi = Xi for 1 < i < n 
and Zj = xj_ n for n + 1 < j < 2n. 

3. Hall-Littlewood Orthogonality 

It is a well known result that Hall-Littlewood polynomials are orthogonal with respect to the density Ag. 
We prove this result using our method below, to illustrate the technique in a simple case. 



Theorem 3.1. We have the following orthogonality relation for Hall-Littlewood polynomials: 
[ P\(xi, . . . ,x„;t)P M (x ] ; 1 , . . . ,a;^ 1 ;t)A^" ) (a;;t)dr = <5 Aai - " 

JT 1 



(t) 



Proof. Note first that by the definition of Hall-Littlewood polynomials, the LHS is a sum of (n!) 2 integrals 
in bijection with S n x S n . Now, since the integral is invariant under inverting all variables, we may restrict 
to the case where A > /i in the reverse lexicographic ordering (we assume this throughout). We will show 
that each of these terms vanish unless A = /i, and this argument will allow us to compute the normalization 
in the case A = /i. By symmetry and (2.1), we have 

pW(*;t)pW(a;-^t)AWir= ; j-^^ £ J^&fr t)R^ (x~\ t)A^ dT. 

Claim 3.1.1. We have the term-evaluation 

<] d (*;t)4: p (x-V)AS n W = fW 



if x^ ■ ■ ■ x* n x p ftl ■ ■ ■ x p uR = 1) an d is otherwise equal to 0. Here i(p) is the number of inversions of p with 
respect to the permutation x^ 1 ■ ■ ■ a;" 1 . 

Note that i(p) is the Coxeter length and recall the distribution of this statistic: ~Y^ p t 1 ^ = [n]l. 

To prove the claim, we use induction on n. Note first that for n = 1, the only term is J x^x^^dT, 
which vanishes unless Ai = fi\. Now suppose the result is true for n — 1. With this assumption we want to 
show that it holds true for n variables. One can compute, by integrating with respect to x\ in the iterated 
integral, that the LHS above is equal to 
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where 

id = id with x% deleted 

p = p with x^ 1 deleted 

A = A with Ai deleted 

p, = ji with ^p-i(i) deleted. 

Recall that Ai > p,\ > fii for all 1 < i < n. Thus, the inner integral in x\ is zero if Ai > p p -i^ and is 

= p p -i(i). In the latter case, note that A > p, so we may use the induction hypothesis 
on the resulting (n — l)-dimensional integral, and combining this with the contribution from x\ gives the 
result of the claim. 

Note that the claim implies each term is zero if A 7^ p, so consequently the entire integral in zero. Finally, 
we use the claim to compute the normalization value in the case X = p. By the above remarks, we have 

T ) P es„: 

1 n p (l) p („) 

Note that the permutations in the index of the sum are in statistic-preserving bijection with S mo ^ x S mi ^ x 
• • • so, using the comment immediately following the Claim, the above expression is equal to 

y t"°' " ! TTlmMl' " ! 

«k. M «... ^>\ir W1 ' 

as desired. □ 



4. a VERSION 

In this section, we prove the orthogonal group integrals with an extra parameter a. This gives four 
identities - one for each component of 0(1), depending on the parity of I. First, we use a result of Gustafson 
[5] to compute some normalizations that will be used throughout the paper. 



Proposition 4.1. We have the following normalizations: 
(i) (symplectic) 



[ A { ^{x;±Vt,0,0;t)dT - 

JT 



(1-*)" 

(t 2 ;t*) n 



(ii) (Kawanaka) 



(hi) (0+(2n)) 



(iv) (0-(2n)) 



(v) (0+(2n + l)) 



(vi) (0-(2n+l)) 



£&> (a;; 1, Vt, 0, 0; t)dT = }\ * } " 



K 

T 



Wf„. 4-1 4-./J.+WT _ il !l! 

2(t;t)2» 



y A^(a;;±l,±\/t;*)dT 



/ A^ -1) (aj;±t,±Vt;«)dT 



(1 -t)"~ ] 
(i 3 ;i) 2 n-i 



A^ (x; i, -1, ± Vt; i)dT - ^ — ^ 



f_ 

JT K (*) *)2n+l 

\n+l 



y A^(a:;l,-t,±Vt;t)dr- 



T " (i;i)2n+l 
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We omit the proof, but in all cases it follows from setting q = and the appropriate values of (a, b, c, d) 
in the integral evaluation: 



A { x>(x;a,b,c, d;q,t)dT = ]'[ 



(t,t 2n - 2 -iabcd; q) 



Q<j<n 



(P+ 1 , Vab, Pac, Pad, Pbc, Pbd, tied; q) '' 



which may be found in [5]. 

We remark that at t = the above densities have special significance. In particular, (i) is the eigenvalue 
density of the symplectic group and (iii) - (vi) are the eigenvalue densities of + (2n), 0~(2n), + (2n + 1) 
and 0~(2n +1) (in the orthogonal group case, the density depends on the component of the orthogonal 
group as well as whether the dimension is odd or even). The density in (ii) appears in Corollary 6.4, and 
that result corresponds to a summation identity of Kawanaka [8] . 

In this section, we want to use a technique similar to the one used to prove Hall-Littlcwood orthogonality. 
Namely, we want to break up the integral into a sum of terms, one for each permutation, and study the 
resulting term integral. The obstruction to this approach is that in many cases the poles lie on the contour, 
i.e., occur at ±1, so the pieces of the integral are not well-defined. However, since the overall integral does 
not have singularities, we may use the principal value integral which we denote by P.V. (see [6], Section 8.3). 
We first prove some results involving the principal value integrals. 

Lemma 4.2. Let f{z) be a function in z such that zf(z) is holomorphic in a neighborhood of the unit disk. 
Then 

/(!) + /(-!) 



p.v. Jm^dT 



Proof. We have 



P.V. 



2tts 



/(*) 



l*l=i 



1 - z- 



-dz 



lim — 

e-^0+ 2 



*/(*) 



| Z |=l-e 



Z 2 - 1 
1 



-dz 



2rr A 



-1 



zf{z)- 



-dz 



\z\=l+e 



But now as zf{z) is holomorphic in a neighborhood of the disk, and the singularities of l/(z 2 — 1) lie outside 
of the disk, the first integral is zero by Cauchy's theorem. Using the residue theorem for the second integral 
(it has simple poles at ±1) gives 



lim — 

2 



Res, 



zf(z) 



(z-l)(z + l) 



Res z= _i 



*/(*) 



(*-l)(z + l) 



/(I) , /(-I) 



1 r 

4 



/(!) + /(-!) 



□ 



Lemma 4.3. Let p be a function in X\, . . . ,x n such that Xip is holomorphic in x% in a neighborhood of 
the unit disk for all 1 < i < n and p(±l, . . . ,±1) = for all 2™ combinations. Let A be a function in 
Xi, . . . ,x n such that A(±l, . . . , ±1, Xi+i, . . . , x n ) is holomorphic in a^+i in a neighborhood of the unit disk 
for all < i < n — 1 (again for all 2 % combinations) . Then 



P V X- a ' n d^ - 



i<i< 

Proof. We give a proof by induction on n. For n = 1, since x\ -p ■ A is holomorphic in x\ we may use Lemma 
4.2: 

-^- f rfT=i[p(l)A(l)+p(-l)A(-l)]. 



P.V. / p-A- 

IT 1— 



But then p(l) = p(— 1) = by assumption, so the integral is zero as desired. 

Now suppose the result holds in the case of n — 1 variables. Consider the n variable case, and let p, A 
in xi,. . . ,x n satisfy the above conditions. Integrate first with respect to X\ and note that x% ■ p ■ A is 
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holomorphic in x\ so we can apply Lemma 4.2: 



P.V.fp A- 11 _ X _ 2 dT= jP.V. f p(l,x 2: ...,x n )A(l,x 2 ,...,x n ) J] _ 2 dT 

Jt l<i<n 1 X i JT n -! 2<i<n X i 

If 1 

+ tP-V. / p(-l,x 2 ,...,a; n )A(-l,a;2,...,a; n ) J~[ ^ 2 rfT. 

Jt »- 1 2<i<n 1 ^ 

But now the pairs x 2 , . . . , x n ), A(l, X2, • ■ • , x„) and p(— 1, £2, . . . , £„), A(— 1, a; 2 , . . . , £„) satisfy the con- 
ditions of the theorem for n — 1 variables a; 2 , . . . , x n , so by the induction hypothesis each of the two integrals 
is zero, so the total integral is zero. □ 

For this section, we let p 2n — (1,2,..., 2n). We also let l k = (1, 1, . . . , 1) with exactly k ones. As above 
we will work with principal value integrals, as necessary. For simplicity, we will suppress the notation P.V. 

Theorem 4.4. Let l(X) < 2n. We have the following integral identity for + (2n): 
1 



fAP(±l,±Vt)dT 



J P x (xf\...,x± 1 ] t)AP(±l,±Vi)l[(l-axt 1 )dT 



4>2n(t) 



v x {t){l-tf 



(— a \# °f odd Varts o/ A _|_ i_ a ^# of even parts of X 

[2n]! \,_^# of odd parts of X _|_ f a \# of even parts of X 



vx(t) 

Proof. We will first show the following: 

r n 1 

J R x (xf\ . . . , xt 1 ; t)AP (±1, ±Vt) - ^xf)dT = 2n(1 _ f)w Pf[a i , fc ] A i 
where Pf denotes the Pfaffian and the 2n x 2n antisymmetric matrix [aj i fc] A is defined by 

a j,k =( 1 + a2 )X(Xj-j)-(X k -k) odd + 2(-a)X(\ j -j)-(\ k -k) even, 

for 1 < j < k < 2n. 

First, note that by symmetry we can rewrite the above integral as 2 n n\ times the sum over all matchings 
w of aii , . . . , x^ 1 , where a matching is a permutation in S 2n such that Xi occurs to the left of a;" 1 and Xi 
occurs to the left of Xj for 1 < i < j < n. In particular, x\ occurs first. Thus, we have 

/ R[ 2n) (x^;t)A^(±l;±Vt) "[[(l - axf)dT 

2—1 

/n 

where the sum is over matchings w in S 2n . 

We introduce some notation for a matching w € S 2n . We write w = {(ii, i'i), ■ • • , (*n, *^)} to indicate that 
Xfc occurs in position if. and x^ occurs in position i' k for all 1 < k < n. Clearly we have i/c < for all k 
and < for all j < k. 

Claim 4.4.1. Let A = (Ai,...,A2 n ) with Xi > X 2 > ■ ■ ■ > X 2n G Z. Then we have the following term- 
evaluation: 

2"n!P.V. f R X , W (4\ xt 1 ;t)AP(±l, ±V~t) f[(l - axf l )dT = a^,, 

^ T i=l ^ ' l<fc<n 

where e(w) is the sign of w and af k ., is the {it, i'f.) entry of the matrix [aj.fc] A • In particular, the term integral 
only depends on the parity of the parts Ai, . . . , A 2n - 
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Let [i be such that A = /i + p2 n - We give a proof by induction on n, the number of variables. For n = 1, 
there is only one matching — in particular, xj -1 must occur in position 2. The (principal value) integral is 



x \ 1 -\ 2 ( 1 -~ tx i )(^-axi){l-ax 1 , dT 



h 1 ) 



(l-a?! ) (l-tx\){l-tx^ ) 



x a 1 -a 2 (l-axi)(l-aa; 1 



Ai-A 2 (1 + « 2 ) - a(gi 

(l-ixf)(l-xr 2 ) 



and Ai — A2 > 0. Note that the conditions for Lemma 4.2 are satisfied. Applying that result gives that the 
value of the integral is 2(— a) /2(1 — t) if Ai — A2 is odd, and (1 + a 2 )/2(l — t) if Ai — A2 is even, which agrees 
with the above claim. 

Now suppose the result is true for up to n — 1 variables and consider the n variable case. Note first that 
i\ = 1. One can compute, by combining terms involving x\ in the iterated integral, that 



« n 
2«n! / RZ\x ±1 ;t)A^\±l,±Vt)Y[(l-axt 1 )dT 

i—l 



Ai-A(/ (1 - OXi)(l 



n 



(t — XiXj) 

(l-txf)(l-X^) AX 

-1 7 -1 

3; 1 -< Xj -< w X 1 -< w Xj 

(t — X±Xj )(t — XlXj) 



n 



(1 — tX\X 1 )(1 — tX\Xj) ' 



dT)F?.-dT, 



where 



F~ x = 2-V - 1)!%^^, . • . , xt 1 ;t)K^- 1 \±l, ±Vt) !](! - <*4 1 



and A is A with parts Ai,Aj' deleted; w is w with xi,x 1 1 deleted. 

In particular, the conditions for Lemma 4.2 are satisfied for the inner integral in x\. Note that the terms 

(t-XiXj) (t-xix' 1 ) 
(1 - tXiXi) (1 - txix' 1 ) 

give 1 when evaluated at x\ — ±1, so the above integral evaluates to 



4 (! - *) 



(l + a 2 -2a)( 



n 



1 — fx. 



+ F^.(l + a 2 +2a)(-l) Al -M( 



n 



t + Xj 

1 + tx. 



dT. 



Xl^ lv Xj^ lv X-, -<u,X- 



But now since (t — Xj)/(1 — ixj) and (i + Xj)/(1 + txi) are power series in Xj, we may apply the inductive 
hypothesis to each part of the new integral: we reduce exponents on Xj modulo 2. We get 



1 



4(1 - t) J Tn _, 



F 



X.w 



(1 + a 2 ~ 2a) 



n (-^)) 

3? 1 ~n 3: j -< w CC ^ 1 -< w X 7 1 



Fr 



(l + a 2 + 2a)(-l) Al " A 'i( 



n 



dr. 
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But now note that 

n n n (-i) 2 =(-i)<- 2 , 

xi^( UJ Xj^( w x^ 1 ~( w x~ 1 x±^( w Xj -4 W X^ ^wxT 1 x\~i w Xj -^-wxj 1 ^-ujX^ 1 

since i\ — 2 is the number of variables between x\ and x^ 1 in the matching w. We can compute 

(l + a 2 -2a)(-l)' 1 ' 1 - 2 + (l + a 2 + 2a)(-l) Al " Al i = (l + ^)[(-l)^ + (-l) x ^]-2a[(-l)^ + (-l) Xl ~^ 

_ f2(-l) l 'i(l + a 2 ) if Ai - Af/ - 1 is odd, 
|-4(-l) 4 'ia if Ai - A^ + i' x - 1 is even. 

Combining this with the factor 1/4(1 — t) and noting that 

( n 

x 3 : 

with 

A = (A 2 + 1, . . . , Aj^-i + 1, Aj' i+1 , . . . , A 2n ), 

gives that 



P n 

Tu\ \ R^\ x ^t)A%\±l,±V-t)l[(l-a X r)dT 

i—1 

= 2 " 2 ( 1 (n _~ ) 1)! <^ 1 (- 1 / 1 jf Jlx 1 «(«fS..M^i 1 ;t)A^ 1 )(±l,±^nV-«^ 1 )ir. 



Now set /2 = (/i2, • • • , Mi' -i) M«i+i; • • • > A^n), and note that A and /I + pi n -i have equivalent parts modulo 2. 
Thus, using the induction hypothesis twice, the above is equal to 

2"- 1 (n- l)! gA f p _ .^ A( „-i) / 



2(1 -t) 11 ^ 



« A 



l) 1 ' 1 / i?p +P2 „_ 2 ^(xf 1 ,..., a ;±l 1 ;i)A^~ 1) (±l,±v^)n( 1 -«^ 1 )^ 

i=i 

= e(w) -pr 2+ P2n _ 2 = e(w) yr 

2(1 - 1) 2 n " 1 (l-f)™~ 1 -1-1 a i fe ,i' fe 2™(l-t)« -1-1 ~ik,i' k 

K ' y ' 2<k<n y ' \<k<n 

as desired. This proves the claim. 

Note in particular this result implies that the integral of a matching w is the term in 2 n (i-t) n -Pf[ a j,fc] A 
corresponding to w. 

Now using the claim, we have 

„ n 
/ R x (xf\. . . , zf; t)AW(±l, ±Vi) rj(l ~ azf)dT 

= Tn\ J2 PV 7 ^A^(xf, . . . , ^;f)4 B) (±l, ±Vt) - axf^dT = Pi [ aj , k ] x 

w a matching ^ i—1 

in S2n 

since the term integrals are in bijection with the terms of the Pfafhan. 

Now we use this to prove the theorem. Using Proposition 4.1 (hi), we have 



1 



« n 

J P x (xt\...,x± 1 ] t)AP(±l,±Vi)l[(l-axt 1 )dT 



fAP(±l,±Vt)dT 

2(l-t)(l-t 2 )...(l-i 2 ») 1 A (l-t)(l-t 2 )-..(l-t 2 ") 1 , 



v x (t)2 n (l-t) n 1 3 ' 1 (l-t) 2n V X (t)2* 
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But now by [4, 5.17] 



■) n — 1 



(_ a )£i=ll\f mod2] + r^E^iKAi+l) mod2] 



which gives the result. 

Theorem 4.5. Let l(X) < 2n. We have the following integral identity for 0~(2n 
(1-a 2 ) 



71- 1 



fA^- 1) {±t,±Vi)dT 



J Px(xf\. . . , x±l lt 1, -1; tJA^-^Cit, ±Vt) J] (1 - aa^JdT 

<fen(*) 



«A(t)(l-t) 2 



(-a) 



# o/ odd parts of A 



(-a) 



£=1 

# o/ even parts of A 



□ 



Proof. We will first show the following: 



„ 71—1 

y ^(^f 1 , . . . , x±i u i,-i; t)A^- i) (±^, ±vt) n (! 



(i+*) 



2 2™- 1 (l-i) 



— Pf[M] A , 



where the (2n + 2) x (2n + 2) antisymmetric matrix [M] A is defined by 

'Ml A 2=0 

M i,k = {-l) Xk - 2 - {k - 2) if fc > 3 

if k > 3 

if 3 < j < k < 2n + 2 



Mi k = 1 



and the 2n x 2n matrix [a Ji fc] A is as in Theorem 4.4. 

Note first that the integral is a sum of (2n)\ terms, but by symmetry we may restrict to the "pseudo- 
matchings" — those with ±1 anywhere, but cc, to the left of x^ for 1 < i < n — 1 and Xi to the left of Xj 
for \ <i<j<n — 1. There are (2n)!/2 n_1 (n — 1)! such pseudo-matchings, and each has 2 n ~ 1 (n — 1)1 
permutations with identical integral. 

Claim 4.5.1. Let w be a fixed pseudo '-matching with (—1) in position j and (+1) in position k (here 
^ l£ j k < 2n). Then we have the following: 

~ n— l 

2 n '\n - 1)! P. V. y R x>w (xf\ • • • » *n-i> ±1; i)A^ 1} (±t, ±Vt) J] (1 - axf^dT 

1—1 

= 2 n -\n- l)!(-l)^+ fc - 2 +x,> fc lii^lp.v.y i?^ l - 1)) (a; ±1 ;t)A^ 1) (±l,±Vt) JJ(1 - axf^dT, 

where w is w with ±1 deleted (in particular, a matching in S2 n -2) and X is X with parts Xj, Xk deleted and 
all parts between Xj and Xk increased by 1, so that (in the case j < k, for example) 

A = (^1, • • • , <\j_l, ^j + l +!,•••> Afc_l + 1, Afe + i, . . . , A2n)- 

We prove the claim. First, using (2.4), we have 



2™- 1 (n-l)!A^- 1) (±t,±v / t) 



n 



1 — X 



±2 



1 X i Xj 



, , ;n _ 1 (i+tef)(i-tef i )(i+^r)(i-^ ±i ) 1 < 4< n„_ 1 i .., .., 



txt'xf 1 ' 



Define the set X = {(xf 1 , x^ 1 ) : 1 < i ^ j < n — 1}, and let u^ w X \x; t) be defined by 
Rx, w {xf\ x±i v ±l; t) = u^-'Hx; t) ]J 



(z z , Zj )eX: 
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Also define p\ and Ai by 



l-xf 2 1 



(n_1) (a;;i) TT +i tt f +1 ^T" TT (1 - "zf 1 ) - Pi TT - 



2—1 * 



a (1 + - tef^l + Vtef ^(l - Vtarf 1 ) fjf 

and 



l<i<j<n-l 2 J (z„ 2j )£X: 1 1 

Note that 

ri-1 

1 

„-2 ' 



n— 1 n— 1 ^ 

Ex,u,(^^, ■ • ■ , i^i, ±1; *) A^~ 1} (±t, ±Vt) J] 0- ~ ax t X ) = Pi A i II T~ 

i - J- V 



1=1 i=l x * 

Define analogously P2 and A2 using i?^ ^(x^ 1 , . . . , ! ;t) and A^ _1) (±l, ±Vt) instead of (x ±1 , ±1; t) 
and A£ _1) (±t,±Vt). 

Then one can check Ai = A2 =: A and A(±l, . . . , ±1, Xi+±, . . . , x n -\) is holomorphic in x^+i for all 
< i < n — 2 and all 2 l combinations. Also, the function p — pi — (— l) Aj+fc ~ 2 p 2 (resp. p = 
Pi — (— l) A i+ fc ~ 1 Ll±*l p 2 ) satisfies the conditions of Lemma 4.3 if j < A; (resp. j > fc). So using that result, 
we have 

j pi .a. n ^^-(-d^-^/^-a- n r^ dT 

J l<i<n-l i J l<i<n-l i 

if j < and 

r P1 .A. n r J ^^=(-D^- i ^/p 2 -A- n r^ dT 

J l<i<n-l » J l<i<n-l ' 

if j > k. Thus, in the case j < k we obtain 

/ fl AiW (a^ 1 , . . . , x^, ±1; i) a£- 1} (±t, ±Vi) I] (! «^')^ 

2—1 

= ( _ 1) A J+fe -2(i+^) J iIXifl( ^i > ... ) ^ 1 .t)A^ 1 )(M,±^nV-««f 1 )ir, 

and analogously for the case j > fc, which proves the claim. 

As in Theorem 4.4, we introduce notation for pseudo-matchings. We write {(j, fc), («i, i'i), . . . , (i n -x,i' n -x)} 
for the pseudo- matching with —1 in position j, 1 in position k and in position if., x^ 1 in position i' k for 
all 1 < k < n — 1. Note that we have ik < i' k and i; < ik for / < k. We may extend this to a matching in 
<%„+!) by + 2), (2, k + 2), (t x +2,^ + 2),..., (i„_ x + 2, £_ x + 2)} = {(j x = =j + 2), (j 2 = 2,f 2 = 
k + 2), . . . , (j n+1 ,j' n+1 )}, with i k + 2 = j fc+2 and i' k + 2 = j^. +2 for all 1 < fc < n - 1. 

Claim 4.5.2. Let w = {(j, fc), (ii, i x ), . . . , (in-i> *n-i)} ^ e a pseudo-matching in Sim and extend it to a 
matching {(ji = = j + 2), (j 2 = 2,f 2 = k + 2) . . . , (j„+i, f n +i)} °f S 2 ( n +i) as discussed above. Let 

X = (Ai, . . . , X 2n ) with Ai > X 2 > ■ ■ ■ > X 2n G Z. Then we have the following term-evaluation: 

« n— 1 

2"-!(n - 1)! P. V. / Rx, w (xf\ • • • . *n-i> ±1; i)A^ 1} (±i, ±Vt) JJ ( x 

t=i 

= i±* £ M TT m x ■, 

2 2 n - 1 (l-t) n - 1 

v ' l<fe<n+l 
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We prove the claim. Let fj, be such that A = /i + pi n . By Claim 4.5.1 the above LHS is equal to 

^(n-lJK-l)^ 2 ^/^ j<k, 
\2»-i(n-l)!(-l)V^ii_+*l/i^ j>k, 

= 2 n - 1 (n - lJliiif-lJJ'i+^'-^WM^M^ 



P n—1 

• J R-^(xf\. . . , a£ i; t)A&- 1} (±1, ±v^) II (1 - axf^dT 



where ca(iy) is if j( > j'2 (i.e., (l,ii) and (2,^2) do not cross) and 1 if they do. Now we may use Claim 
4.4.1 on the (n — l)-dimensional integral: let ju be the partition \x with parts fj,j and /ife deleted; note that A 
and + p2n-2 have equivalent parts modulo 2. Using this, we find that the above is equal to 

2™" 1 (n - ^^(-lJjJ+ii-i-^t^M^M^., 

n—1 

• / ^+p 2 „- 2 -(^i :1 ---,^-i;OA^ 1) (±i,±v / t)n( 1 -^ ±1 ) dT 

•' T 1=1 
= i±*(_i)Ji+iS-i- Ca (i») M A m a TT a ^»-= 

V ' l<fc<Tl-l 

= 1+j e(w) -pr A 

2 2™ _1 fl — -l-^ JfeJ'fc' 

V ' l<fc<n+l 

as desired. 

Note that in particular this result shows that the integral of a matching is a term in Pf[M] A (l + t)/2"(l — 
t) n -\ 

Now using the claim, we have 

J R x {x^ ,...,xtUA,-^ { K~ 1 H±t,±Vi)l[(l-axt 1 )dT= (1 + * ) 2n _ 1(i 1 _ f)n _ 1 Pf[Ai]\ 

since the terms of the Pfaffian are in bijection with the integrals of the pseudo-matchings. 
Finally, to prove the theorem, we use Proposition 4.1(iv) to obtain 



jA^- 1) (±t,±Vi)dT 



f Px(xf\. . . , a£ l5 1, -l;t)A^~ 1 \±t, ±Vt) hV - axt^dT 
J i=i 



v x (t)(l - t) n+1 2 n (l-t) n - 1 1 1 v\(t)(l-t) 2n 2™ L J 

Following the computation in [4, 5.21] (but noting that they are missing a factor of 2), Pf[Af] A may be 
evaluated as 



2" 



f-cAEjZl&i mod2 l _ (_ Q ,)E J 2 2i[(A J +l) mod2] 



(1-a 2 ) 

which proves the theorem. □ 
Theorem 4.6. Let 1(A) < 2n+ 1. We have the following integral identity for + (2n + 1): 
(1-a) 



jA^(t-l,±Vt)dT 



f P x (xf\ . . . , xt\ 1; t)A%\t, -1, ±Vt) f[(l - axf^dT 

J 2 = 1 

( — a y# °f odd parts of X ^ t_ a \# of even parts of A 



i=l 

<hn+l{t) 



« A (*)(l-t) an+1 
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Proof. We use an argument analogous to the O (2n) case. We will first show the following: 
J Rx(xf\ . • . , x±M; t)A^ (t, -1, ±Vt) H(l - axf^dT = - Pf[Af] A 



i=l 



where the 2n + 2 x 2n + 2 antisymmetric matrix [M] is given by 

fM 1 A fe = l ifl<fc<2n + 2 

\M£ k = a^-g^ if 2 < j < fc < 2n + 2, 

and as usual [oj,fc] A is the 2n + 1 x 2n + 1 antisymmetric matrix specified by Theorem 4.4. The integral is a 
sum of (2n + 1)! terms, one for each permutation in £?2n+i> But note that by symmetry we may restrict to 
pseudo-matchings in S2 n +i' those with 1 anywhere but Xi to the left of x~ l for all 1 < i < n, and x^ to the 
left of Xj for 1 < i < j < n. There are (2n + l)!/2"n! such pseudo-matchings, and for each there are exactly 
2 n nl other permutations with identical integral value. 

Claim 4.6.1. Let w be a fixed pseudo-matching with 1 in position k, for some 1 < k < 2n + 1. Then we 
have the following: 

~ n 

2 n n\ P. V. / R x , w (xf\ ■ • ■ . *n \ 1; (*> -1. ±Vt) II^ 1 - a^ 1 )^ 

i=l 

« n 
= 2"n!(-l) fc - 1 P.V. / R- x ^(xf\...,x± 1 ;t)A%\±l,±Vi)l[(l-axt 1 )dT, 

J 4 = 1 

where w is w with 1 deleted (in particular, a matching in S2n) oxid X is X with A& deleted and the parts to 
the left of Xk increased by 1, i.e., 

X = (Ai + 1, . . . , Afc-i + 1, Afe+i, . . . , A2 n +i). 

We prove the claim; note that this proof is very similar to Claim 4.5.1 for the 0~ (2n) case. First, using 
(2.4), we have 

2"n!A ( " ) (i,-l,±v / i) = TT Ti +1 " ' r +1 p-rr- TT W - 

Define the set X = {(a;* 1 , a;* 1 ) : 1 < i ^ j < n}, and let t) be defined by 

R x A^\---,rt\^) = u^ w {x;t) J] Z -^^ 

Also define pi and Ai by 

, . , : „ (1 - tefKl + xfKl - Vtxf l ){l + Vtxf) ii - - i - , , 



(z,,z 3 )€X: Zt j 



and 



n 1 x » x j TT z » ~ tz J _ A 

1 _ +T± l T± l 11 Z- - Z- 

l<z<j<n 1 tX i X j ( Zt , Zj )eX: Zl Zl 



Note that 



1 1 Tl 

R x , w (xf\ 4\ 1; *)A^(t, -1, ±Vfc)JI(l - oaf 1 ) = piA t J] — 



-2 • 



Define analogously p 2 and A 2 using R^ ^ (x 1 1 , . . . , a;^ 1 ; t) and A^ (±1, ±\/i) instead of i?^ ™ ) (a; ±1 , l;t) 
and A^ l) (t,-l,±\/t). 
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Then note that Ai = A2 := A. Some computation shows that A(±l, . . . , ±1, Xi+i, . . . , x n ) is holomorphic 
in Xi+i for all < i < 11 — 1 and all 2 l combinations. Further computations show that the function 
p = pi — (—l) k ~ 1 P2 satisfies the conditions of Lemma 4.3, so we have 

2 — 1 * 

or, 

f Pl ■ a x . n j^ff = [ P2 ■ a 2 . n dr, 

i=l 1 x i J i=l 1 X i 

which proves the claim. 

In keeping with the notation of the previous two theorems, we write {(k), (ii, {[),..., (i n ,i' n )} for the 
pseudo-matching w with 1 in position k and x k in position if., x^ 1 in position i' k , for all 1 < k < n. We 
can extend this to a matching in SW-n+i) by {(1, k+ 1), (ii + + 1), ...,(i n + l,i' n + 1)} = {{ji = — 
k + 1),..., (j n+1 ,j' n+1 )}, with i k + 1 = jk+i,ik' + 1 = jfc+i for 1 < < 

Claim 4.6.2. Lei w = {(fe), (ii, i^), . . . , (i n , i' n )} be a pseudo-matching in S^n+i, and extend it to a matching 
{(ii = 1) fi = k + 1), . . . , (in+i> Jn+i)} as discussed above. Let A = (Ai, . . . , A 2n+ i) with \ x > A 2 > • • • > 
A2n+i G Z. TTien we /icwe i/ie following term-evaluation: 



M x .,. 



2"n! P. V. / fl A , w (4 \ . . . , xt\ 1; t)A^ (t, -1, ±Vt) f[(l - az^dT = - ^ — JJ 

»=1 ^ ' l<fc<ra+l 

We prove the claim. Let p be such that A = fi+ p2 n +i- By Claim 4.6.1 the above LHS is equal to 

„ n 
2"n!(-l) fc - 1 / R^.(xf\...,xt 1 ;t)AP(±l,±Vi)Yl(l-axf)dT 
Jt i=i 

„ n 

= Tn\(-iy'^ +1 M^ f / R- x -(xf\. . . , xt 1 ;t)A^(±l, ±Vt) axf)dT. 

Jt *=i 

Now we use Claim 4.4.1: let /x be p with part pk deleted; note A — l 2 ™ = p + pm- Using that result, the 
above is equal to 

/n 
RMp 2n A4\---,< 1 lt)^\±h±Vi)l[(l-axf 1 )dT 
i=i 

= (-i)i!-Mi M A TT a M+p 2 . = e H TT M A 

v ' JUi 2™f1 — tV 1 J-J- l k< l k 2 n (l — t) n 

V ' l<fc<n V ' l<fe<n+l 

as desired. 

Note that in particular this result shows that the integral of a matching is a term in 2 ™{i-t) n [M] x . 
Now using the claim, we have 

f ™ 1 

y i^f, ■ ■ ■ ,x±\ l;t)Ag>(t, -l,±Vt) - axf x )dT = ^ - t)K Pf[M] A , 

since the terms of the Pfafhan are in bijection with the integrals of the pseudo-matchings. 
Finally, to prove the theorem, we use Proposition 4.1 (v) to obtain 



(1-a) 



jAP(t,-l,±Vt)dT 



f P x (xf\ . . . , xt\ l;t)A%\t, -l,±Vt) f[(l - axf^dT 

J 2 = 1 

{1 - a)<t>2n+l{t) 1 pfrwiA 

v A (i)(l-i) n+1 2"(l-t)» 1 J ' 
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but by a change of basis [M] A is equivalent to the one defined in [4, 5.24], and that Pfaffian was computed 
to be 



2" 



(1-a) 



(-ajE'^IAj mod2 I + (_ Q ,)i: 3 2 "| 1 [(A 3 +l) mod2] 



which proves the theorem. 



□ 



Theorem 4.7. Let l(X) < 2n + 1. We /ia«e i/ie following integral identity for O (2n + 1): 



1 + a 



/A^(i,-t,±vi)dr 



±i 



±\ -1; t)AW (1, -t, ±V*) !](! - 



02n+l(*) 



WA W(l-i) 2 " +1 



Proof. We obtain the 0~(2n + l) integral from the + (2n + l) integral. See the discussion for the 0~ (2n+l) 
integral in the next section. The upshot is that the 0~(2n + 1) integral is (— 1)' A ' times the + (2n + 1) 
integral with parameter —a. Using Theorem 4.6, we get 



, 1 x|A| 4>2n+l(t) 

1 ' v x (t)(l-t)^ 



q# of odd parts of A _|_ of even parts of A 



But note that (-1) A * is -1 if X, is odd, and 1 if A, is even, so that (-1) |A| = of odd parts of A . Also, 

/ 1)^ °^ od d parts of A / 1)^ °^ cvcn P al 'ts of A / -^^2n+l ^ 

Combining these facts gives the result. □ 

We briefly mention some existing results related to Theorems 4.4, 4.5, 4.6, and 4.7. First, note that these 
four results are t-analogs of the results of Proposition 2 of [4]. For example, in the + (2n) case, that result 
states 

(det(l 2 „ + aU)s p (U)) Ue0+{2n) = ^Pffo*] = a& [ « mod2] + a^=^ +1 *> ™ d2 \ 

where (■)o+(2n) denotes the integral with respect to the eigenvalue density of the group + (2n). 
Also, note that the a — case of these identities gives that the four integrals 

| J P x (xf\...,xt 1 ;t)A^(±l,±Vi)dT 

| J P x (xf 1 ,...,x^ 1 _ v ±l;t)A^- 1 \±t,±Vt)dT 

- J P x (x±\...,x±\l-t)A%\t,-l,±V~t)dT 

| J P x {xf\...,x^\-l-,t)K^\l,-t,±yft)dT 

vanish unless all 2n or 2n + 1 (as appropriate) parts of A have the same parity (see Theorem 4.1 of [13]). 
Here Z is the normalization: it makes the integral equal to unity when A is the zero partition. 

5. a, ft VERSION 

In this section, we further generalize the identities of the previous section by using the Pieri rule to add 
an extra parameter ft. The values are given in terms of Rogers-Szego polynomials (2.3). 

Theorem 5.1. We have the following integral identities: 
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(i) for 0(2 ? i) 

1 

jAP(±l,±Vt)dT 



P n 

j PM\- ■ .,x^-t)K^\±l, ±Vt) H(l - oxf x )(l - pxf^dT 



(l-c^)(l-/^) 

fA^- 1) (±t,±Vi)dT 

24>2n(t) 



~ n—1 
J P^xf 1 , x±\, 1,-1; t)A ( ^- 1 \±t, ±Vt) J] (1 - oasf^Cl - ^ ±x )dT 



«, M (t)(l-t)>- „ 
(ii) /or 0(2n + 1) 
(l-a)(l-/3) 



[( n m; *) n *wnM ov*; *)) (-«) # o/ 



odd parts of fi 



fA%\t,-l,±V~t)dT 

(l + a)(l + /3) 



/A^(l,-t,±v^)dT 

" W/1 (t)(l-t)2"+ 



/ P M (z±\ . . . 1; -1, ±Vt) f[(l - axf l )[l - pxf l )dT 

J t=i 

y p^xf, . . . -i; 0A^(i, -t,±v*) n^ 1 - a ^ ±l )( i - ^ ±x ) rfT 



i>0 i>0 



Proof. The proof follows Warnaar's argument (Theorem 1.1 of [15]), with the only difference being that we 
take into account zero parts in the computation whereas Warnaar's infinite version is concerned only with 
nonzero parts. The basic method is to use the Pieri rule for P^(x; t)e r (x) in combination with the results of 
the previous section (the sum of the results of Theorems 4.4, 4.5 for 0(2n) and similarly Theorems 4.6, 4.7 
for 0(2n+ 1)). Note that Warnaar starts with the case a = b = in his notation (the orthogonal group case) 
and successively applies the Pieri rule two times, introducing a parameter each time. Because we proved the 
a case in the previous section, we need only use the Pieri rule once. □ 

Theorem 5.2. Write A = O mo( - A - ) l mi ( A ) 2 m ' 2 ^ ■ ■ ■ , with total number of parts 2n or 2n + 1 as necessary. 
Then we have the following integral identities for the components of the orthogonal group: 

(i) forO+(2n) 



- y P x (xf\ . • . , xt 1 ;t)A^(±l, ±Vt) Y[(l - axfXl - Pxf^dT 



< ^T?W [ ( II H ^ W («# t) n H mM+l(x) (/? /a; tj) (-a)* 



if odd parts of A 



i>0 



v x (t)(l-t) 

' [] H m2i+1 w (a/3; t) \{ H m2i (A) (/3/a; t) ) (-a)* °' ™™ " arts « A 



i>0 i>0 



(ii) forO~{2n) 



(l-cO(l-/3*) 



« n— 1 

y p^xf, . . . i, -i; t)A^- i \±t,±vt) na - ^fx* - ^f 1 )^ 

2 — 1 

-^3S5T [ ( II H ™ 2i (a) («/?; t) II W *)) (~«) # o/ ° dd Parts o/ X 



v x (t)(l-t) 

' II ^m 2i+1 (A) (a/3; i) J] P m2i(A) (/3/a; i)) (-a)# ^ ««* A 



i>0 
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(iii) forO+(2n + l) 

J p a(x ±i ,...^±1 ^t)A%\t,-l,±Vt)f[(l-axf 1 )(l-Pxt 1 )dT 

1 — 1 

= K n w t) n ^(aj *)) (-«) # o/ ° dd parts o/ a 

i>0 i>0 

(iv) for 0-(2n + l) 

(1 + ^ 1 + /3) / ^(^..., a ^,-l;t)AW(l ) -t ) ±^n( 1 -^ 1 )( 1 -^ 1 )ir 

- ( II ^ +1 (A) *) II H ™»m *)) (-«) # 0/ e " e " ports 0/ A 

i>0 i>0 

where Z is the normalization at a = 0,/3 = and A = 2n ,0 2ra+1 as appropriate. 

Proof. Note that the Hall-Littlewood polynomials satisfy the following property: 

i 

(T[zi)P\(zu...,zi',t) = P x+1 i(zi,...,zi;t). 



So in the case 0(2n), for example, we have 

Pfi ipl j ... j x, 

P^{ x \ 1 i ■ ■ ■ i x n-li 1) — 1) = — P^+l 2n ( x f L i ■ ■ • i x n-li 1 ^ 1 ^ ■ 



-^(^l ; ■ • ■ ; i ^) — -F/i+1 2 " (^1 ! • • • ) x n i ^) 
±1 ±1 -, D . f_±l „±1 



Thus, 



/A^(±l,±^)dT 



« n 

/ P^sf 1 , . . . , iB ± 1 ;t)A^ ) (±l, ±Vt) JJ(1 - axf x ){l - pxf^dT 

i—1 



(l-a 2 )(l-/3 2 ) 
J A^' 1) (±t,±Vi)dT 
1 



« n— 1 

y P^xf 1 , . . . , a^, 1,-1; t)A^ 1) (±t, ±Vt) J] (1 - <0(1 - /Sxf X )dT 



P, +l2n (a:* 1 , . . . , i* 1 ; *)AW (±i, ±Vt) - axf 1 )^ - Pxf^dT 

i=i 



jAP(±l,±Vt)dT 

t 1 -^ 1 -^ J Pfi+12n {x f\. . . , x^, 1, -1; i)Ar X) (±^ if (1 - ^(1 - P x t r )dT 



fA^- 1) (±t,±Vt)dT. 

= - ^#17^ [( n fl™*0H-i-) *) n H^^woi «)) (-«) # ° f ° dd — ° f - +i2 



where the last equality follows from Theorem 5.1(i). Now note that v^+i^n (t) = v^(t), m;(/i+l 2 ") = m;_i(/i) 

;r of odd parts in /i + l 2 ™ is the same as the number of even parts 

■ [ ( II («# *) II *)) (-«) # of ovcn parts of 



for alH > 1, and the number of odd parts in /i + l 2 " is the same as the number of even parts in \i. Thus the 
above is equal to 



i>0 i>0 
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Then, taking the sum/difference of this equation and Theorem 5.1(i), we obtain 
2 

jAP(±l,±V~t)dT 

2 " 2 " " ! ■ [( n («a *) n *)) (-«) # ° f ° dd parts ° f - 



P n 



« A (t)(i-*) 



2;> 



i>0 i>0 

, (a/3; t) [] H m2i{x) (/3/a; t)) (-a)# of cvon parts of A 

i>0 i>0 

and 



/ft _L 
P A (xf, . . . , z^, 1, -1; <)A^- 1} (±i, ±Vi) J] (1 " <*4 l )Q ~ P x t l )dT 

l — l 

2M) ^ jj ^ ^ {a0i t) -J-J f) j ( _ a)# of odd parts of A 



w A (t)(l -t) 2 " - 



( n H m 2 ^w Wi t) n h ™**w *)) (-«) # ° f ° vcn parts ° f a 



i>0 i>0 



as desired. The 0(2n + 1) result is analogous; use instead Theorem 5.1(h). Note alternatively that as in the 
a case, we can obtain the 0~(2n + 1) integral directly from the + (2n + 1) integral, since the change of 
variables xi — ¥ — Xi gives 

« n 

/ P x (xf\ . . . -l;i)A^(l, -t,±Vt) - axf 1 )^ - pxf^dT 

~ n 

= y P x (-xf\...,-xt\-V,t)AP(-l,t,±Vi)l[(l + axt 1 )(l + pxt 1 )dT 

i—1 

= (-l)l A l y P x (xf\...,xt\l;t)AP(-l,t,±Vt)l[(l + axt 1 )(l + Pxt 1 )dT, 

i=l 

and / A^ i) (l,-t,±v / t)dT = / A^° (-1, t, ±Vt)dT, so that 

(1 + a)(1+ P) ' y Px(xf\ ...,xt\-l; t)AP (1, -t, ±>/t) fi(l - <«f X )(l - l*4 X W 

+ (3xf 1 )dT, 



/AW(i, -t,±Vt)dT 

_ ( -1)^(1 + a)(l + /3) /■ ^i > .. Ma ± l)1 . t)A W(_i,t, ± ^)JI(l + a^ 1 )(l 



which is (— 1)' A ' times the + (2n + 1) integral with parameters —a, — /3. □ 

We remark that Theorem 5.2(i) may be obtained using the direct method of the previous section. One 
ultimately obtains a recursive formula, for which the Rogers-Szego polynomials are a solution. However, 
this argument does not easily work for 0~(2n), + (2n + 1) and 0~(2n + 1). Thus, it is more practical to 
use the Pieri rule to obtain the 0{l) (I odd or even) integrals, and then solve for the components. 

6. Special Cases 

We will use the results of the previous section to prove some identities that correspond to particular values 
of a and j3. 

Corollary 6.1. (a = —1) We have the following identity: 

I / P^(x^;t)AP(±l,±Vi) fi(l + *f )(1 - f3x?)dT = I[H mi(x) (-P;t), 
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where the normalization Z = J A£ (±1, ±\/t)dT. 
Proof. Just put a = — 1 into 5.2 (i). □ 

Corollary 6.2. (a = — ft) We have the following identity: 



f n 

\ J p^\ x ^t)AP(±i,±v-t)Yia- a 2 4 2 )dT 

_ 4>2n{t) 
~ V X (t)(l-t) 



[( n ^w(-« 2 ; *) n *)) (-«) # ° f ° M parts ° f x 



i>0 i>0 

\# of even parts of A 
i>0 i>0 

where the normalization Z = J A^p (±1, ±\/t)dT. In particular, this vanishes unless all odd parts of A have 
even multiplicity, or all even parts of A have even multiplicity. 

Proof. Just put a — —(3 into Theorem 5.2(i). For the second part, we use [15, 1.10b]: H m (—l;t) vanishes 
unless m is even, in which case it is (t; i 2 ) m /2 = (1 — t)(l — t 3 ) • • • (1 — □ 

Corollary 6.3. Symplectic Integral (see Theorem 4-1 of [13]). We have the following identity: 
!/■/+! +i sXM, r , M?) C°Jt 2n ;0,t 2 ) 

w/ien X ~ fi 2 for some /i cmc? otherwise (here the normalization Z = f A ^\±\/t, 0,0) dT). 
Proof. Use the computation 

A^(±Vt,0,0) = AP(±l,±Vt) [] (l-^ 1 )!!-^ 1 )!^^, 

l<i<n 

and Corollary 6.1 with (3 = 1. The result then follows from [15, 1.10b]: H mi t X )(~ l;t) vanishes unless mi(A) 
is even, in which case it is (1 - i)(l - i 3 ) • ■ • (1 - f^PO-i). □ 

We remark that this integral identity may also be proved directly, using techniques similar to those used 
for the orthogonal group integrals of Section 4. In fact, in this case, there are no poles on the unit circle so 
the analysis is much more straightforward. 

Corollary 6.4. Kawanaka's identity (see [7], [8]). We have the following identity: 

1 / D ^±l „±l,^AMn /Inns ^(V*) _ C°(t n ; , V~t) 



J P x (xf 1 ,...,x± 1 ;t)AP(l,Vi,0,0) = 



ZJ AV 1 n ' ' ' ' ' (l-Vt) 2n v x (Vt) C-(Vt;0,Vt) 

(here the normalization Z = J Ajp(l,y/i, 0, 0)dT). 
Proof. Use the computation 

A£ ) (i,Vt,o,o) = A£ ) (±i,±V*) II (i-^f 1 )^-^ 1 )!^-!,^-^ 

l<i<n 

and Corollary 6.1 with (3 = -y/i. The result then follows from [15, l.lOd]: H m (y/t;t) = YlJ^l + {Vt) ] ) ■ D 

7. Limit n — > oo 

In this section, we show that the n — > oo limit of Theorem 5.2 (i) in conjunction with the Cauchy identity 
gives Warnaar's identity ([15, Theorem 1.1]). Thus, Theorem 5.2 (i) may be viewed as a finite dimensional 
analog of that particular generalized Littlewood identity. 
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Proposition 7.1. (Gaussian result for + (2n)) For any symmetric function f, 

lim ^ = I G (f;m;s), 

r ^°° J AP (x;t;±l,t 2 ,t 3 )dT 

where \t\, | ^2 1 5 ^3 1 < 1 and m and s are defined as follows: 

t 2k-l +t 2k-l 

mik-\ ~ " 



m 2 k 



1 - < 2fc -! 

Ik I 4-2k 
i, 2 T t-3 



tl k + t\ k + 1 - t k 



l_ t 2k 

k 



l~t k ' 

Here /g(;to;s) is the Gaussian functional on symmetric functions defined by 

deg(/) 

^- 1 / 2 e - ( -P3~ m i) 2 / 2s i dpj. 



f f n (2^ J -)- 1 

jRdog(/) 



Proof. This is formally a special case of [12, Theorem 7.17]. That proof relies on Theorem 6 of [3] and 
Section 8 of [2]. The fact that two of the parameters (to, . . . , £3) are ±1 makes that argument fail: however, 
replacing the symplectic group with + (2n) resolves that issue. □ 

Note that a similar argument would work for the components 0~(2n),0 + (2n + 1) and 0~(2n +1). 

Proposition 7.2. We have the following: 



I II \ tX3V fi IK 1 - - Pvi 1 ) a£ } (»; t; ±i,h, t 3 )dT 



lim ■ 

n— >oo 



J A.P(y;t;±l,h,t 3 )dT 

_ (t 2 a,t 3 a,t 2 j3,t 3 j3;t) j-r 1 - tx jXk j-r (1 - *asf)(l - okCj)(1 - jSxj) 

Proof. Put 



(aH,pH;t 2 )(ap;t) 11 1 - Sj-ar* 1.1 (1 - i a aJi)(l - *3»i)(l - + ' 



/ - n na - ^ x )d - ^) - ex P ( e - tk) pkiy){ak + pk) 



(see [11] for more details). Then use the previous result, and complete the square in the Gaussian integral. □ 
Corollary 7.3. We have the following identity in the limit: 



I n \ tX]V t IK 1 ^X 1 - W fa *; ^ ±^) dT 

" 1 - r j!ti. 



lim 



j,k k 



J A%\y;t;±l,±Vi)dT 

_1 tt 1 - te 3 Tt -r-r (1 - axj)(l - /3xj) 

i#*T-!4 i-a;,-a; fc Ai~a 



Proof. Put £2,^3 = ±vt in the previous result. Also note that 

(Via;t)(-Via;t) = {ta 2 ;t 2 ) 

so that 

(a 2 i,/3 2 i;i 2 ) ~ ' 
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□ 



Theorem 7.4. We have the following formal identity ([15] Theorem 1.1): 

E p ^ *) [( II (A) («# *) II H m 2i+1 (x) (p>; *)) (-«) # 0/ 0<M parts 0/ A ] 



i>0 



i>0 



TT 1 - tXjXk TT (1 - CCTjXl - /3Zj) 



Proof. We prove the result for |a|, |/3| < 1, then use analytic continuation to obtain it for all a, (3. We start 
with the Cauchy identity for Hall-Littlewood polynomials (2.2). Using this in the LHS of Corollary 7.3, and 
multiplying both sides by (a/3; t) gives 



(a/3;t) VP A (x;t) lim 

z — * n— >oo 



r6 A (t) / Pa^ 1 , . . . , y* 1 ; t) \[ k {l - ayf )(1 - ^^^(y; i; ±1, ±v^)dT 



/A^(y;i;±l,±Vt)dT 



_ -i-r 1 - -r-r (1 - a£j)(l - ftoj) 

~ M 1 = x ? Xk T (i-^OCi+^i) ' 

Now note that the quantity within the limit is the a,/3 version of the + (2n) integral, see Theorem 5.2 (i) 
Using that result, the above equation becomes 



(a/3; t) £ Pa(x; t) lim f . ±> [( ]J H m2i{x) (a/3; t) J] ^Wi(A) C/9/«i «)) ( 

+ ( II ^.w ("ft *) II w G8/«; *)) (-«) # of ovon parts ° 



\# of odd parts of A 



i>0 



i>0 



1 — tXjXk TT (1 — aXj)(l — /3Sj) 



n l - LXjXk TT VJ_ 
. 1-XiXk W (1 



But note that 



b x (t) {l-tf 



so that 



v\(t) 4> mo {\){t) 

b\{t)<j> 2n (t) = <j>2n{t) _ /-, _ f m {\)+l\ f-i _ f 2n\ 

v x (t)(l-t)^ <j> mo{x) (t) [ J '" 1 j ' 

which goes to 1 as mo(A),n — > oo. Moreover, as mo(A) — > oo, we have 

<Afno(A)(*) 



m (\) 

H mo (\)(a0;t) = E 



m (A) 
3 





m (A) 




= E 


. t 




™o(A) 

£ - 


_ £7710 (A) 







f^ <t>j(t)<t>mo(X)-j{t) ^ 
(1 — f; m °(A)-i+lUl _ £"*o(A)-;;+2\ ,..(]__ £"io(A)\ 



(a/J)' E 



But for |a/3| < 1, it is an identity that this is l/(a/3;i). 

Finally, we show that the second term in the sum vanishes. We must look at 

lim (-a) fc J ff mo(A) (/3/a;t), 

mo(A).fc— >-oo 

where k is the number of even parts, so in particular k > mo (A). We have the following upper bound: 

771-0 (A) 



?710(A) 



(A)^oo ^ (l-t)3 



3=0 
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the sum is geometric with ratio /3/a(l — t). Thus, this is equal to 



1 _ ^iLV"° (A) + 1 a rn oW _ y°<*Hi 



lim a mow* vg^v = lim ^ 

m (A)^oo l-THT^T ™o(A)^oo 1 - 

But since a,/3 are sufficiently small (take \(3\ < |1 — t\), this is zero, giving the result. □ 

8. Other Vanishing Results 

We introduce notation for dominant weights with negative parts: if fi, v are partitions with + l{y) < n 
then [iv is the dominant weight vector of SL n x GLi, [iv = (fix, . . . , Mi(»> 0> ' " • ) 0) ■ ■ • > — ^l)- Often, 

we will use A for a dominant weight with negative parts, i.e., A = \iv. 

In this section, we prove four other vanishing identities from [13] and [12]. In all four cases, the structure of 
the partition that produces a nonvanishing integral is the same: opposite parts must add to zero (A;+A; + i_; = 
for all 1 < i < I, where I is the total number of parts). Note that an equivalent condition is that there 
exists a partition \i such that A = [ip. 

We comment that the technique is similar to that of previous sections: we first use symmetries of the 
integrand to restrict to the term integrals associated to specific permutations. Then, we obtain an inductive 
evaluation for the term integral, and use this to give a combinatorial formula for the total integral. We 
mention that the first result corresponds to the symmetric space (U (m + n), U(m) x U(n)) in the Schur case 
t = 0. 

Theorem 8.1. (see [12, Conjecture 3]^ Let m and n be integers with < m < n. Then for a dominant 
weight A = [iv of U(n + m), 

If 1 -p-,- 1 — Xixj 1 -p-p 1 — ViHj 1 

P li u(xx,...,x m ,yx,...,y n ;t)- r - - — — II z — ; — — dT = 0, 

unless [i — v and < m, in which case the integral is 



C^(t;0,t)C^(t m + n - 2 t;0,t)' 
Here the normalization Z is the integral for fi = v = 0. 

Proof. Note first that the integral is a sum of (n + m)\ terms, one for each element in 5„+ m . But by the 
symmetry of the integrand, we may restrict to the permutations with Xi (resp. yi) to the left of Xj (resp. 
yj) for 1 < i < j < m (resp. 1 < i < j < n). Moreover, by symmetry we can deform the torus to 

T = {|y| = l + e; |a:| = l}, 

and preserve the integral. Thus, we have 

1 1 - xixj 1 1 - yiyj 1 



f R -fx (m) v [n) -t)— 17 XiX * TT ViV > dT 



-1 1 „..„.- 1 



Vi^wVj for X<i<j<r 

We first compute the normalization. 
Claim 8.1.1. We have 



wGS n + m 1 l<i=£j<m 3 \<i+3<n 

Xi^ w Xj for Ki<j<m 



Jt n\m\ ±i 1 - t Xl x, 1 - *UiVi 



\<i^j<m 3 l<i^j<n 



tyiVj 1 ' 4>n(t)4> m (t)' 
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Since 

1 _ (1 - t) m+n 

U( n+m)(t) (j>m+n(t) 

this is equivalent to showing 



1 yj 1-XiXj 1 1 — ViVj 1 jj> _ <j>m+n(t) 



j j^o^.yW;*)* n n 7 

J n\m\ 1 - ta^., , 1 



, - tyiVi 1 J <f>n(t)<i>m(t) ' 

We may use the above discussion to rewrite the LHS as a sum over suitable permutations. Let w € SVi+r. 
be a permutation with the x, y variables in order and consider 

1 - x^J 1 „ 1 - yiyj 1 



JT , , , , 1 — IXsXa , , 1 



dT. 



Integrating with respect to xi, . . . , x m ,yx, . . . , y n in order shows that this is i# lnvcrslons of w j where inversions 
are in the sense of the multiset M = {0™, l m }, and we define yi ■ ■ ■ y n x\ ■ ■ ■ x m to have inversions. But now 
by an identity of MacMahon 



E 

multiset permutations w of {O™,!™ 1 } 



inversions of w 



Til + n 

n 



_ <f>m+n(t) 
t 0n(t)0m(i)' 



which proves the claim. Note that we could also prove the claim by observing that 

[ Po„ +m (xW, y («) ;t )J_ JJ JJ i-M^iT = -i-f/ AW( i; t)AW(y;t)<ff 

^ n!m! i<i'<» 1 - i<iy< n 1 - n!m! ^ 



and using the results of Theorem 3.1. 

For convenience, from now on we will write 



1 - XiX- 1 T-r 1 - yiy~ 1 



A(*W;»W;t)= TZT^ II 7T f^ = 4 m, (»;W(y;t), 



_ ^ ( m ) f^. +\ A (™) I 

, . . 1 - fx,-?/ -1 

for the density function. 

Claim 8.1.2. Let w £ S n + m be a permutation of {x( m >, y^ n '} with Xi -< w Xj for all 1 < i < j < m and 
Vi Vj f or all 1 < i < j < n. Suppose 

R^. w (x {m) t)A(x<ri ; y {n) ; t)dT £ 0. 

T 

Then w has y\ . . -yi(^) in first l(fx) positions, and x m -u v -\+x . . ■ x m in the last l(y) positions. Consequently 
l{y) < m, l{y) < n. 

We prove the claim. We will first show that if, in w(x, y)^ v , x\ has exponent a strictly positive part, the 
integral is zero. Indeed, one can compute that the integral restricted to the terms in x\ is: 

cf TT TT - to i TT x _l^i dT = ^ 

J -- L Xi — tei J -- L Vi — Xi J -- L x\ — y-j 

since by assumption jttj > 0. 

Dually if in w(x,y) fML ', y n has exponent a strictly negative part, we can show the integral is zero. The 
integral restricted to the terms in in y n is: 



-Q Vn_]H_ JJ Xi JVn JJ Vn t Xj ^ 

l<i<n Vn tVl x^ wVn X l Vn y n ^ w x s Vn X i 



f y-pi tt m ~ tt y" z tx ^ tt 

Jt:\x\>\v\ n y^ - tyn „ i 1 yn - aij i „ 



^_Jyn dT 



It:\x\>\v\ x < 4< „ - ty» ^^^^ y« - xj vn ^ x ^ Xj - y n 

where in the second step we have inverted all variables which preserves the integral. But now by assumption 
Vi < 0, so integrating with respect to y n gives that the above integral is zero. This gives the desired structure 
of w to have nonvanishing associated integral. 
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Claim 8.1.3. Let w G S n + m be a permutation of {x^- m \ y '-"•'} with Xi ~< w Xj for all 1 < i < j < m 
and yi < w yj for all 1 < i < j < n. Suppose also that yi, . . . , Ui^) are in the first l(/j,) positions and 
x m-i(u)+ii ■ ■ ■ i x m are in the last l(v) positions. 

Let l(p) > 0. Then we have the following formula for the term integral associated to w: 

Rpv.w (x {m) , V (n) ; t)A(x^ ; ; t)dT 



T 



Yl t n+m ~ l ) f %~(x( m - 1 \y( n - 1 '>;t)A(x ( > m -V;y( n -V-t)dT 



Ai+A;=0 



where w is w with yi,x m deleted and X is X with A x and Aj deleted (where index i is such that Ai + Xi = 0). 
Similarly, if l(v) > 0, we have 



J R^Ax (m \y {n) \t)A{x^-y^-t)dT 



(l-i)( ]T /%, iS ^ (ro - 1) ,2/ ( "- 1) ;i)A( a; (ro - 1) ;y ( "- 1) ;t)dT 



where w is w with y\ , x m deleted and X is X with Xi and A n+m deleted ( where index i is such that Xi + A n+m = 
0). 

For the first statement, integrate with respect to y\. We have the following integral restricted to the terms 
involving yy. 

,.Ai TT Vi-Vi TT tx i 



n ^ n ^^dT, 

Ki<n y y l<j<m y 3 

with Ai = fii > 0. Evaluating gives a sum of m terms, one for each residue y\ — Xj. We consider one of 
these residues: suppose Xj is in position i, then the resulting integral in Xj is: 



° Ki<n Vt ~ tX: > ift Xj ~ Xl vi^xi Vl ~ x i xj^vi x i ~ Vi i<j x i ~ tXl j<i Xl ~ tx i 



yi^yi 



= (i-t) / ^ 1+A * TT (-i)^^\\{-i)^^dT, 



x^ wVi Vt tx J j<i Xi tx i 

where we may assume Ai < 0, by the structure of w. Note first that if Ai + Xi > 0, the integral is zero. One 
can similarly argue that the term integral is zero if Ai + A^ < (use X n +m + A/j < for any 1 < k < n + m 
and integrate with respect to x m , and take the residue at any x m = yi). Thus for a nonvanishing residue 
term we must have Ai = — Aj, and in this case one can verify that the above integral evaluates to 

(1 - t )t l{z:x ^ wZ}l = (1 - t)t n+m -\ 

as desired. 

The second statement is analogous, except integrate with respect to x m instead of y\, and invert all 
variables. This proves the claim. 
Thus, 

j R^Ax im \y {n) ;t)A(x^;y^;t)dT = 

unless [i = v and l(y) < m, which gives the vanishing part of the theorem. For the second part, suppose 
H = v and l(p) < m. Then by the above claims, 

R^. w {x [m) , y (n) ; t) A(x^ ■ y<»>; t)dT 

T 

- (l-t) l ^v,+ (t) j i? 0( „- UM ,, + ^-u,)), 5 (x (m -' (,y)) , 2 ; (n - /W) ;i)A(x( m -'^»; 2 ;( n -'^);t)rfr 
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if w = yi . ..yi{n)Sx m _i^ +1 . ..x m for some permutation 8 of {j/j^+i, ■ ■ ■ , y n , zi, ■ ■ ■ , x m -l(v)}, an d other- 
wise. 

By Claim 8.1.1, we have 



i? (,i-!(K)) + (>™-!(K)) (X 

So we have 



A(x 



(■m-l(ji)) . y(n-l(n)) 



>;*) 



(m-J(/i))!(n -*(/*))! 



dT = 



P wl (x^ .yW; i) J- A(x(" 1 ) ; „ W ; i)«fT = (1 - V (t) 

n!m! %M*J 



m + n — 2Z(/i) 
n — 

m + n— 2l(fi) 



Noting that v^^t) = v^(t) Vr m+n-2i( f i,)\(t) and multiplying by the reciprocal of the normalization gives 



\ I P^\y^t)^A(x^ n ht)dT= frOM*) (l-^) Krt 



(1 U M+ (t)« (0 m+„-2 iW) (t) 



m + n — 2Z(/i) 
n — 



(1 _ t n-i(/0+l) ...(!_ f «)(! _ t ™-i(c)+i) .. . (i _ t m )- 



( Pm-\-n—2l(fi 

)(*) 



(1 - t)" l +"- i (^)^ + (t) U(0m+ „_ 2Utl)) (t) 

= (i~ty^ v , + (t) ' 

where the last equality follows from the definition of Vf m+n-2i^)\. One can check from the definition of the 
C-symbols that 

C+(t m+n - 2 t;0,t) = 1 

C-(t;0,t) = v tt+ (t)(l-t) l M 



l<i<l{n) 



so that our formula gives 



as desired. 



C°Jt n ,t m ;0,t) 



C^(t;0,t)C+(t m + n -H;0,t)' 



□ 



Theorem 8.2. (see [12, Conjecture 5]) Let n > be an integer and X = pv a dominant weight ofU(2n). 
Then 



If 1 i 

^ J^P^(x 1 ,...,x n ,y 1 ,...,y n ;t)j-^ J[ 



TT IT (l-xtxJ^l-Uiyr^dT, 



is equal to unless u = v, in which case the integral is 

C°(t n ,-t n ;0,t) 



C^(t;0,t)C+(t^-H;0,t)' 
Here the normalization Z is the integral for fj, = v = 0. 

Proof. Note first that the integral is a sum of (2n)\ terms, one for each element in S^n- But by the symmetry 
of the integrand, we may restrict to the permutations with Xi (resp. y%) to the left of Xj (resp. yj) for 
1 < i < j < n - By symmetry, we can deform the torus to 

T = {\y\ = l+e-\x\ = l}. 
For convenience, we will write A(x^ n ' ; j/"* 1 ; t) for the density 



n 



— ]][ (l-x^yi-y^j 1 ). 



3 I l<i^j<n 



We first compute the normalization. 
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Claim 8.2.1. We have 

Z = / T P 0a .( a (-), tf (-);t)^A( a (»); tf C»);t)cff=^. 
By the definition of U(o 2 ™)(t), this is equivalent to showing 

We prove this statement by induction on n. For n = 1, we have 

#12/1 



(#i - yi)(yi - *#i) 



dT = o 



and 



#12/1 1 _ <h(t) 



(2/i -#i)(#i -tyi) 1-t (1 - t) 2 0i(i 2 ) 
as desired. Now suppose the claim holds for n — 1; with this assumption we show that it holds for n. 

Consider permutations w with xi first. We claim J T Rfj.v,w{^ n \ t)A(x^ ; z/™); f)dT = 0. Indeed, we 
have the following integral restricting to the terms in x\\ 

xi — tyi -r-r xi — txi yj xiyj yj (xj — xi)(xi — Xj) 



yr Xj - l Wl yr Xj - LXj yr X iyj yr yXj - Xj^Xj - -^j) ^ 

\\ xi-yi X! - Xi Al (yj - txi)(xi - tyj) A. A xix, 

#l2/j TT (#1 - fcgjK#j - #l) 



Ti 



TT ^1% TT ixi - t-x jn x 3 - ^1) dT 

iii (#i -%•)(%•-*#!) #1^ 



^ l<y<n (a:i "^'" tel) li<n 

Thus, we may suppose yi occurs first in w. A similar calculation for the integral restricting to terms in y\ 
yields: 

/ 2/1 n (vi-tyjM-yi) U {yi -J {Xt - tyi) dT - 

J 11 Kj<n l<i<n Vy n y ' 

We may evaluate this as the sum of n residues, one for each y\ = Xi for 1 < i < n. We compute the residue 
at ?/i = Xi, and look at the resulting integral in xf. 

y— f J ]J (Xi- t yj )( yj -Xi)]]_ _ x Y[(x ir - tXi)(Xi - X V ) J| (Xi - tX VI )(x VI - Xi) 

Kj<n jjti 1 3 i'<i i<i" 

. TT I TT I d T = — !— [ TT {tXl " - Xl) TT toi-^ xr 

Vi¥=yi 

But, letting 2 < k < In be the position of Xi in w, this evaluates to 

i jfln—k 

r^n* n >='— 

i<i" Xi-twVj 

Thus, varying over all such permutations with y\ first gives a factor of 

1 (1 _ f 2n-\\ 

-(t 2n - 2 +t 2n ~ 3 + ---+t+l) = ( 1 



Note that permutations of {y\, . . . , y n , x\, . . . , x n } with y\ in position 1 and Xi in position k are in bijection 
with permutations of {y 2 , • • • , 2M> #i) • • • > #i> • ■ • > So using the induction hypothesis, the total integral 
evaluates to 

(l-^ 2 "' 1 ) h(n-l)(t) = <h n (t) 

(1-t) 2 (l- t )2( n -l)^_ 1 (i2 ) (l-t)^^)' 

as desired. 
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Note that the density is not of a standard form (i.e., as a product of Koornwinder or Selberg densities), 
so we cannot appeal to an earlier result (compare with Claim 8.1.1). 

Claim 8.2.2. Let w G S^n Q> permutation of {x^ n \y^} with Xi -< w Xj for all 1 < i < j < n and yi -<, w yj 
for all 1 < i < j < n. Suppose 

I R^. w (i'"' , y {n) ; t)A(x^ ; ; t)dT + 0. 

JT 

Then w has y\ . . -yu^) in the first 1(h) coordinates, and x n -i^ + i ...x n in the last l{y) coordinates. Conse- 
quently l(v) < n, l(/i) < n. 

The proof is analogous to Claim 8.1.2 of the previous theorem. 

Claim 8.2.3. Let w G San & e a permutation of {x^ n \y^} with Xi ~< w Xj for all 1 < i < j < n and yi -< w yj 
for all 1 < i < j < n. Suppose also that y±, . . . , yi( p ) are in the first l(ji) coordinates, and x n _ir v -\ + i . . .x n in 
the last l(y) coordinates. 

Let l(fi) > 0. Then we have the following formula for the term integral associated to w: 

J iW (* (n) . y (n) ; t) A (^ (n) ; v {n) ; 

= ( E t 2 "^/i? A , ffi (^ 1 ^y (n " 1) ;0A(x("- 1 ) ;y ("- 1 );^T 

Ai+Ai=0 

where w is w with yi,x n deleted and X is X with Ai and Xi deleted (where the index i is such that Ai + A.; = ) . 
Similarly, if 1(f) > 0, we have 

R„p, w (x (n \y {n) ;t)A(xW;yW;t)dT 

= r L( ^- 1 )/%, ffi (^"- 1) I 2/ ( "- 1) ;t)A(^- 1 );^- 1 );t)dT 

A,+A 2n =0 

where w is w with yi, x n deleted and X is X with A,: and A271 deleted (where the index i is such that A^+A2n = 0/ 

The proof is analogous to the proof of Claim 8.1.3 of the previous theorem. 
Thus, 

/ iW(* (B) , y (n) ; t) A(x^ ; y(»> ;t)dT = 

JT 

unless /i = v. Moreover, if fj, = v, the integral is 

—J—v M+ (t) J J? 02 „- 2i(tl) , 5 (^("- i M),t/("- i M);t)A( : r(«- i W);y(»- i W);t)rfT 

if w = y\ . . . yuji)5xn-l{v)+\ ...x n for some permutation 8 of {yi^+i, ■ ■ ■ , y n , %i, ■ ■ ■ , x n -l(v)} and otherwise. 
By Claim 8.2.1, we have 

[ r, ,„ ,r*<-«»» „<■>-'<»» ■ t) I ;/'"-"-»; _ W 

J T ^-"' {X ( (2 „_ 2i(fl))! ) 2 ^"(i -.)*-» WW) 

Thus, 

z J t ^X ,y ,t) {nl)2 ^X ,V ,t)dl - UM+(t) 2 U(o2 „_ al((i))(i)(1 _ i)IM (l-t)2n-2 I( M)^_ I(M) (i2) 
_ (1 - ^W) ■■■ (1 - ft 2 )") 2n _ 2iM (t) = (l-(t 2 )"-^) + l)...(l-ft2)n) 

«„+(*)(! -t)2«-'0«) u (02 „- 2!W) (t) <v+(t)(l - 



VANISHING INTEGRALS FOR HALL-LITTLEWOOD POLYNOMIALS 



21) 



where the last equality follows from the definition of Vf 2n-2i(^)\(t). Finally, one can check from the definition 
of the C-symbols that 

C+(t 2n - 2 t;0,t) = 1 

C°(t n ,-t n ;0,t)= Y[ (l-i 2(n+1 ~ l) ) 
i<t<J00 



so that our formula gives 



as desired. □ 

Theorem 8.3. (see [13, Theorem 4.4],) Let X be a weight of the double cover of GLm, i.e., a half-integer 
vector such that Xi — Xj G Z for all i,j. Then 

1 fp(2n) ( .±111 ,,1 TT (l-Zj/zjXl-Zj/zj) 

z r x [ 1 ' j <<y< (i-* 2 ^)(i-^M) ~ ' 

l<t<j<n 

unless A = /i/i. 7?t, £/us case, i/ie nonzero value is 

M* 2 ) C°(t",-t";0,t) 



(1 - t) B «„(*)(l + + t 2 ) ■ ■ ■ (1 + C,T(i; 0,t)C+(t 2 "- 2 i; 0,t) ' 

Proof. As usual, note that p^ 2 "^. . . t ±1 / 2 z i • • • ; t) is a sum of (2n)! terms, one for each permutation in Sin- 
We first note that many of these have vanishing integrals: 

Claim 8.3.1. Let w G Si n be a permutation of (t ±1 / 2 zi, . . . ,t ±1 / 2 z„), such that for some 1 < i < n \ftzi 
appears to the left of ^ in w. Then 

' R^{---t ±1 ' 2 z l ----t)h^\z-t 2 )dT = Q. 



To prove the claim note that R^Z (' ' ' i ±:L ^ 22; i ' ' ' 1 1) — in this case. Indeed, we have the term 

y/tZj -tZj/y/t _ tZj - tZj _ 

VtZi - z l /y/i Zi(t - 1) 

appearing in the product defining the Hall-Littlewood polynomial. 

Thus, we may restrict our attention to those permutations w with Zij \ft to the left of \ftzi for all 1 < % < n. 
Moreover, we may order the variables so that Zij\ft appears to the left of zj/^/t for all 1 < i < j < n. We 
compute the normalization first. 

Claim 8.3.2. We have 



Z= / P^\---t ± ^z l --- ;t)-Af\z;t 2 )dT. 



n! 6 v ' ' v {Qn) (t 2 ) (1 - i 2 )(l - i 4 ) ■ - ■ (1 - t 2 -)' 
The proof follows by noting that Pfpn\' • • t ±l / 2 Zi ■ ■ ■ ; t) = 1 and applying Theorem 3.1. 

Claim 8.3.3. Let w G Si n be a permutation with Zi/\/t to the left of \ftzi for all 1 < i < n and Zi/y/i to 
the left of Zj / \/t for all 1 < i < j < n, and \ftz\ in position k for some 2 < k < In. Then 

= X x 1+ x k =o(l + t)t 2 - k [ 4 2( :'- 1)) (---* ±1/ V" ;i)A^ 1) (z;i 2 )dT 

where w is the permutation w with zi/^/i and \fiz\ deleted, and X is the partition X with parts X\ and 
deleted. 
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To prove the claim, integrate with respect to z\. Note that if Ai + A^ > 0, the integral vanishes. If 
Ai + Afc < 0, note that A2« + Aj- < for all 1 < j < 2n — 1. Integrate with respect to the last variable in w, 
and invert all variables to find the integral vanishes, as desired. 

The above claim implies that the integral J T R^^j '(■ ■ ■ t ±l l 2 Zi • • • ; t)Ag(z; t 2 )dT vanishes unless A = fijl 
for some \i. Moreover, if A = fj,ft, the term integral vanishes unless 

is a constant in t (i.e., independent of zi). Thus, in the case A = /Lt/2, a computation gives that the total 
integral 



+ / flgjrrg (■ • ■ ■ ■ ■ ; t) _ ) , v At lW) (*; S)dT 



1 

(»-T(/*))! 

= (i + *)'<»V(*) (1 _ f2)(1 _ t4) . . . (1 _ ^5o5) p (°»<--'W))(«)- 

Multiplying this by 1/Zv\(t) — l/Zv^ + (t) 2 v^ Q2 ( n -iM))(t) and simplifying gives the result. □ 
Theorem 8.4. (see [13, Corollary 4.7(h)],) Let X be a partition with l(X) < n. Then the integral 

[ P\(xi,...,x n ;t 2 )P m n.(xi 1 , . . .,x~ 1 ;t)^A < 'g\x;t)dT 

vanishes unless A = (2m)™ — A. 

Note that the above integral gives the coefficient of P m n[x;t) in the expansion of P\(x\t 2 ) as Hall- 
Littlewood polynomials with parameter t. 

Proof. Since P m n (x^ , . . . , x" 1 ; t) — {x^ 1 • • • a;" 1 )™ 1 , an equivalent statement is the following: 
Let A be a weight of GL n with possibly negative parts. Then the integral 

\ J Px(xi,...,x n -t 2 )^A ( ™\x;t)dT 

vanishes unless A = (xp,, and in this case it is 

(l_t»-M00+i)...(i_i»)fW 
(l-t 2 )'Wu M+ (i 2 ) ' 

We first compute the normalization Z = j P^\x;t 2 )A^ l \x;t)dT. Note that P 0n {x]t 2 ) — 1, so we 
have 

1 f XW/„^-i f p(")L.rtp(")/.-i.^AW/r- 1 n! - £ ~ f )" 



using Theorem 3.1. 



i\v (on) (t) (l-t)(l-*a)..-(l-f) 



Now we look at --7 J R\(x\, . . . , i„;t 2 )Aj' (x; t)dT, which is a sum of n! integrals — one for each to e S n . 
By symmetry we have 

1 1 4")(a ; ;t 2 )AW(a ; ;i)dT = | flWfc i 2 )A^(x; t)dT, 

so we may restrict to the case w = id. We assume Ai > 0: note that if Ai < we have A„ < (we are 
assuming A is not the zero partition) and we can invert all variables and make a change of variables to reduce 
to the case Ai > 0. Then the integral restricted to terms in xi is 



f x Xl TT Xl - t2xj TT ( Xi ~ x i)( x i ~ Xi ) dxi f x *i tt ( Xl ~ ^fjKgj ~ Xl ) dxi 

^ 1 7>1 Xl ~ X 3 f>l (X!-tXj){Xj - tXl) 2TTy/-LX! J Tl 1 fj[ (Xl - tXj)(Xj - txi) 2-Ksf-ixi 



^t^Mf Al -pr (tXj - £ 2 xQ(Xj - tXj) \ - t Al (l - Al -pr (gj ■ - tXj)[Xj -tXj) 

h ft~ t2 ) X ° Av^-to*)^-* 8 ^) it ft"* 2 ) Xj iM^-<K*i-* 2 ^) ; 
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where the second line follows by evaluating the residues at x\ — txj for j > 1. For each j > 1, we can 
combine this with the terms in Xj from the original integrand. The integral restricted to terms in Xj is 

t 1 (1 i} f \ 1 i |" i, x j ^ x i}i^ x i txj^ i |" X\ t Xj i |" Xj t Xi 



n\Xj i.Xi)\Xi — ix j) Xj -|—r xi i Xj -|—r 



(1 - Jti 3 AK ( x j - x i)( x i ~ t2x j) 



TT ( x i ~ x j)( x j ~ x ») jjgj _ (1 ~ ^) 2 /" a , A i+ A i I 1 X)" - "' TT — — ^ 

(x, - te,)(x 7 - - to,) 27r v /= Tx 7 - ~ (l-^ 2 ) 7 j *r*~.x l ~t 2 x j 2itJ~^lx 1 ' 
Now, this is if Ai + Aj > and 

t Al (l -t){t 2 ) n - 1 

if Ai + Xj = 0. Finally, if Ai + Xj < note that A„ + A<j < for all 1 < i < n. We can invert all variables and 
make a change of variables to arrive at the case Ai + Xj > 0, so the integral is zero by the above argument. 

Iterating this argument shows that the partition A must satisfy Aj + A„ +1 _.j = for the integral to be 
nonvanishing. Thus A = for some /i. In this case, we compute from the above remarks: 

i / P^ {x ^)^\x-,t)dT = ^-^- ) J R^ d (x;t 2 )A^(x;t)dT 

Using the computation of Z, this is equal to 

Mt) tM (i-t)'W r M} i 

<t>„(t) tM (l - *)'(") (l - t) n - 21 ^ 4> n {t) *M 



(1 -t)" ^ t+ (i 2 ) (1 + *)'<"> 0„_2, (M )(t) 4>n-2 l[p) {t) (l-t^y(M)v^) 

_ (l-«"- al (/*)+ 1 )...(l-t'»)tH 

~ (i-t 2 )'Wv(t 2 ) ' 

as desired. □ 
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